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ABSTRACT 

Fifty-two college students, enrolled in an 
introductory psychology course, served as subjects for this study, 
the purposes of which were: (1) to determine whether \supplying 

subjects with a list of behavioral objectives causes them to focus 
their learning efforts on the specified behaviors to the extent that 
attention to non-specified behaviors is reduced; and (2) to determine 
whether supplying subjects with training which stresses the nature of 
behaviora lly-stated objectives enables more effectively. The entire 
experimental procedure, including materials used, is clearly 
elaborated. As hypothesized, the findings indicate that possession of 
objectives leads to higher performance on objectives- related test 
items than bn non- objectives- related items. In addition, Ss given 
objectives were able to recall information not mentioned by 
objectives at least as well as ss not given objectives. Finally, no 
support was given to the hypothesis that training in the nature of 
objectives enhances subsequent performance the learning task- 
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Proponents of the mastery learning model for education have stressed 
the value of communicating behavioral objectives to students as a means of 
improving the efficiency of the learning process EBIoom (1968), Block (1971), 
Mayo (1970)!]. One prediction which appears to be consonant with the model 
is that students will learn behaviors specified in communicated objectives 
better than they will learn behaviors not specified in advance. Advocates 
of the use of objectives appear to hold the implicit assumption that students 
will view material relating to the objectives as relevant and to-be- 1 earned, 
and wil I therefore focus upon that materialT 0 - 1 

However, measurement concerning objectives thus far has tended to be 
restricted to specif s (except, of course, in cases in which 

specified behaviors are inadvertantly measured by tests inappropriate to 

. ./ 

the objectives). A research design appropriate for examining learning of 
relevant and nonrelevant material was used by Postman and Senders ( 1946) , 
but was designed to measure the effects of instructional set, not objectives. 

If it were to be shown that possess lor^of behavioral objectives tends 
to cause students to focus their learning efforts on the specified behaviors 
to the extent that attention to non-spec i f led behaviors is reduced, this 

i 

finding would be of practical importance to educators. For, if the effects 
of specifying behavior in advance are significant and predictable, it becomes 
essential (I) to be certain that all essential behaviors are specified to 
the students, and (2) to be equally certain that achievement Is measured 
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by items which do in fact measure the objectives. 

The possibility that students may need to learn how to use objectives 
has been suggested by Boardman (1970), Ye Ion and Schmidt (1971), and Jen- 
kins and Deno (197!). It Is possible that the student who is handed a set 
of behavioral ly stated objectives for the first time might not necessarily 
be able to proceed effectively with his learning task. The student who is 
naive with reference to objectives may need to go through a sort of "psyching 
out" r process before he really understands how to use objectives in his study. 

In addition to examining the effects of communicated objectives on learning 
of specified and non-spec i f led behaviors, this study will examine whether a 
training program emphasizing knowledge about the nature of behavlora I ly- 
stated objectives (and their relationship to measurement items) can aid 

students to utilize objectives more effectively. A closely related question 

„ > 

to re: 3 1 vo attention Is whether such training leads to positive attitudes 

toward the use of objectives. 

If It were to be shown that training is helpful, educators might profitably 
consider using such a program at the beginning of courses In which objectives 
will be provided to students. Such a program might eliminate the need for 
the expending of student energies for "psyching out" what Is to be done with 
objectives. If the training program were also to bring about the development 
of positive attitudes toward objectives, this would represent one more argument 
for. its adoption. 

The present study was designed to determine whether (I) supplying 
subjects with training stressing the nature of behavlora I ly-stated objectives 
enables them to utilize objectives more effectively for a subsequent learning 
task and *eads to positive attitudes toward the use of objectives, and 
(2) whether supplying subjects with a list of objectives causes the subjects 
to focus their learning efforts on the soecl f ied s behaviors to the extent 
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that attention to non-speci fi ©d behaviors is reduced. The hypotheses for 
this study were: 

L. Subjects receiving the most complete training concerning 
objectives will exhibit highest scores on a training test 
over behavioral objectives. 

2. Subjects receiving the most complete training concerning 
objectives will exhibit the most favorable attitudes toward 
the use of objectives. 

3. Subjects who receive the most complete training and who are .. 
provided with a partial list of objectives (List "A") will 
obtain higher scores on criterion test items measuring List "A" 
objectives than will other subjects. 

4. Subjects who receive a parti a! list of objectives (List "A") 
will score higher on criterion test items measuring List "A" 

objectives than on test items measuring objectives not communl- 

/ * 

cated to them (i.e., List "B" objectives). 

5. Subjects who receive no objectives wit'rnot di ffer in achievement 
on the two subsets of criterion test items. 

Method 

Subjects 

-The subjects were 52 sophomores. Juniors and seniors enrolled In a 
class of Introductory educational psychology taught by the Junior author 
at the Uni versity of Georgia. The subjects' were randomly assigned to one 

i 

of six experimental groups. 

Materials 

a. Training materials: Mager's (1962) Preparing Instructional Objectives 

was used In the training condition. Practice materials (stressing evaluating 
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whether an objective Is stated behaviora I ly, the appropriateness of test 
items for given objectives, and recognizing components of well-stated 

\ 

objectives) were also prepared. 

b. Training test: A 30- item measure, based on concepts discussed 

in the Mager text, was used to test the immediate cognitive effects of the 
training treatment. This instrument consisted of 20 true-false i -terns 
concerning (I) whether given objectives are stated behaviora I ly, and (2) 
the appropriateness of given test Items. Ten additional Items called for 
correct under I ini ng of performance criteria contained in given objectives. 

c. Attitude inventory: A self-report measure, in which subjects 

could indicate their interest in and feelings about objectives, was 
developed. This instrument contained 6 items which were 5-polnt, Likert-' 
typo scalar measures, pi us a series of positive and negative words concerning 
objectives. The maximum possible score on this I nstrument Is 34, 

d. Learning task: Bloom's (1968) article, "Learning for Mastery", 

was used as the learning task. TSj- p?»nnr selected because of (l).lts 
relevance to the content of the course, and (2) whereas it forms a coherent 
whole in terms of discussing the mastery model, at the same time it contains 
a number of relatively discrete ideas, points c view, and research findings 
which are, to some extent, isolab le from each other. Since the authors wished 
to communicate only one-half of a total list of objectives to some subjects, 
it was necessary to use a learning task which contained ideas and findings 
with at least some degree of independence from each other. 

e. Objectives: Six major objectives, each calling for retention of 

factual knowledge, were developed from the learning task. The objectives 
were then divided into two lists of three objectives each. The two lists 
were matched for easily visible/embedded material, and were also matched 
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as to location of the material relating to the objectives (each list 

contained one objective relating to material near the beginning, middle, 

<* 

and end of the article). One list (List "A”) was then selected to be 
presented to subjects during the treatment calling for possession of 
objectives. The second list (List M B W ) was not presented to any subjects. 

f. Criterion test: A 40-item, matching-type instrument was developed 
to measure the two lists of objectives described above. List "A M objectives 
were measured by 20 test items; List f, B" objectives were measured by 20 
additional test items. Based on the administration of the criterion test 
to subjects in the present study, an estimate of reliability of .81 was 
obtained (Kuder-Rl chardson Formula 20). 

Procedure 

Subjects were college juniors and seniors enrolled in an introduc ry 

X 

educations p^cholog, a. S nee the task materials were relevant 
materials for the course and since the £ was the teacher, no distinction 
between instructional and experirm®nfa I activities was necessary. Every 
effort was made to make the grouo assignments and task assignments a part 
of the normal activities of the course. Subjects were informed that, as a 
customary instructional procedure, the class would be divided into small 
groups. Six experimental groups were formed by random assignment. Schedules 
indicating meeting times and assignments were given to each group. Further, 
subjects were infromel that w h ? I each of the groups would Initially have 
different assignments, students would be responsible only for the activities 
of their particular group. According to Arygrls (1968) educational and 
psychological researchers are Ju^t beginning to realize the significance 
of the relationship between £ arv w S. Since the resuj+s of this study would 
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be generalized to classroom Instruction, the relationship between £ and £ 
was established and maintained, even after the study was over, as that of 
teacher and learner. 

Treatment I: Training 

Groups I and IV read Mager's Preparing Instructional Objectives , 
and received approximately 100 minutes of classroom Instruction and 
practice on the training materials related to this text. Instruction 

ft , 

centered on the three instructional objectives in the Mager book. 

I 

Materials were prepared for each objective similar to the tasks used 
in the Mager book. Transparencies and handouts were used for class- 

, i 

room discussions. A short format i v '° admin isterec s or each 

i 

objective. The major training effect, if indeed there was to be one, 
was the practical experience of using objectives during learning. 

A major thought in developing the short training procedure was' that 
the procedure should be realistic within the usual context of a college 
course. Thequestfon raised by this treatment Is "Will a relatively 
short training experience with instructional objectives, suitable 
for college instruction, immediately influence a subsequent learning 
task Involving the use of instructional objectives?". 

Group II and V read the same book outside class, but received no 
classroom instruction or further practice. Groups III and VI receive no 
training, and were asked to read and critique an article on student 
unrest. 

At the next class meeting, an attitude inventory was administered 
(on an anonymous basis) to measure attitudes toward behavioral objectives 
and their use. A 30 Item training test, based on the objectives in 
Mager's text was administered to measure the immediate cognitive, 
effects of the training, 
o 
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Treatment 11: » Possession of List "A” Objective s 

All groups were assigned to read Bloom’s (1963) ’’Learning for 
Mastery” outside class, and were told to prepare for a test. With- 
out the knowledge of Groups IV, V, and VI, List' "A" objectives were 
supplied to Groups I, II, and III. These latter groups were told 
to use these objectives in preparing for the test. No Instruction 
was given to any group. 

At the next class meeting, the criterion test was administered. 

Groups I, II, and III were tested separately from Groups -IV, V, and VI. 

\ - 

A summary of the design appears in Figure I. Fifty-one subjects 

completed the training test and attitude inventory; fifty subjects completed- 
the criterion test. For criterion test analyses involving two-way analyses 
of variance, one subject from each of two cells wer* randomly selected to 
be dropped in order to equalize N’s across cells. 

Results 

Training test: A one-way analysis of variance was conducted over the 

results of the test measuring knowledge about objectives. The mean scores 
for the three levels of training differed reliably <F = 40.5, d.f. - I, 47; 
p<.00l). Cell summary data and table for the one-way analysis of variance 
appear in Table I. Following the analysis of variance, the mean for Groups 

V • \ 

I - IV was contrasted with pooled means for Group I i - V and III - VI to 
see whether the addition of class instruction led to significantly better 
test achievement when added to the reading of the Mager text. This selected 
contrast was carried out In order to test the first hypothesis. A D* con- 
trast (Scheffe method, as described by McNemar, pp. 285-86) was used. Accept! n 
alpha as .05 (K = 2.526), 2,48 d.f., D’ for this contrast was 7.24. As 
hypothesized, subjects who received the most complete training achieved 

s 

highest scores on the training test. $. 

O 
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FIGURE ONE 
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of Partial 
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J 

Treatment 1: Training in Knowledge about 


Behavioral Objectives 


- 


Mager booj< + 


Mager bock, no 


No 


i nstructi on . 


instruction 


trai n i ng 


, Group 1 


Group 1 1 


Group 1 II 


Group IV 

/ 


_ _ Group V 


Group VI 



Attitudes: A one-way analysis of variance conducted across the 

three levels of training indicated that training level was significantly 
related to attitude (F =17.71, d.f. = .1,47, p<^.00l). Table 2 contains 
the cell summaries and results of the one-way analysis of variance. When 

the mean score for Groups I - IV was__contrasted with combined means of the 

'• . - ■ \ 

other groups for a D* contrast, D T for this comparison was 4.27 (signffl- 

r • • \ 

cant at .05 level). When .subjects who received the most complete trainfng 

' \ \ 

were compared to all other subjects, results indicated that, as hypothesized, 
complete training produced the most favorable attitudes. • 

» ■* 

Criterion test scores: Three by two analyses of .variance were- conducted 

to test the significance of main effects (Level of Training, and Possession 
of List "A" Objectives),- and their interaction. Analyses were conducted 
separately for test Items measuring List M A M objectives, for items measuring- 
List "B M objectives, and for total test scores. 

a. Cell summary data and results of the two-way analysis of variance 

appear in Table 3. -Test items measuring List "A” objectives: A ; 

si gnl ficant. Row^ effect* emerged: Possession of List ,f A u "object i ves, 

f F = 5.28, d.f. * 2,46, p^.05. However, there were no significant 
effects for Column (.Training: F = v „35, d.f, = 2,4o), or for interaction 

(F = .40, d.f. = 2,46). ..Subjects who possessed List "A” objectives 
passed significantly more items- which measured those objectives than did 
subjects who received no objectives. However, the training treatment 
did not enhance achievement. (In fact, subjects whth objectives but 

who received no training obtained the highest scores of all groups.) 

> * 

Hypothesis #3 was, therefore not supported.. 

» / 

b. A summary of the cell means and the two-way analysis of variance 
table appears in Table 4. Test Items measuring List ”B" objectives: 

- ■ ’ . v 

There were no significant differences In performance on these test items 
for which no subjects received objectives. In fact, means were 
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r©<jv$rkat> jy similar across groups. 

c. Total tost scores : Table 5 contains the cell summary data and ' 
the results of the two~w3y analysis of variance. Total scores on the 
criterion test did not differ significantly. There was no significant 
effect upon total test achievement attributable to Training, Possession 

. i 

of Objectives, or Interaction. 

. I 

3* -Compare five performances on subparts of the criterion test: (I) 

Subjects who possessed List "A H objectives: the mean score on test 

* toms measuring List ”A" objectives for these subjects was 14.04; for 
test Items measuring List n B" objectives, the mean score was 13.0. 

Using a t- test for correlated means (one-tailed), t-1.73, significant 
at .05 level, d,f. a 23, As hypothes I zed,. subjects who possessed objectives 
passed significantly more test Items which related to the objectives 
than I ferns which did not. 

(2^ subjects who possessed no objectives: performance on test items 

assuring list "A** objectives averaged 11.80 for subjects who possessed 
no objectives. On test Items measuring list M B U objectives, their mean 
score was 12.40, The t-test for correlated means (two-tailed) yielded 
t* MI, d*f.«23. As hypothesized, subjects who received no objectives 
did not differ significantly in performance on the two subparts of the 
criterion test, in short, the two subparts do not differ significantly 
In- terms of df f f Iculty, * ^ 






Pi scuss Ion 

As hypothes 1 zed, the findings of this study indicate that possession of 
objectives tod to higher performance on object i ves-re lated test items than on 

i f 

non^bjecTt ves-re fated items. These results are viewed by the authors as 
» 

"This result could be further strengthened by showing no transfer effects 
trow Ust ”AV to list n B t! on an independent group of subjects. 

- ' 10 
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consonant with the mastery learning model. It Is likely that one of the chief 
benefits which students derive from using behavioral objectives Is that objec- 
tives enable them to organize and retain essential points of a large body of 
learning material. The degree of facilitative effect objectives provide for 
students is probably directly related to the quantity of learning material 
with which the student must deal. Since the learning task in this study was 
relatively short, this experimental design probably represents a conservative 
test of the effects of specifying desired behavior. 

While a major effect of using instructional objectives is to increase 
test scores over the objective related material, objectives do not constrict 
Ss * recall of additional concepts from the same material; that is, Ss given 
objectives could recall information not mentioned by objectives at least as 
well as Ss not given objectives . Hence, we do not find in this study any 
tendency for the Sswho were given objectives to attend only to the information 
related to the objectives. 

Proponents of the model of learning for mastery [Bloom (1968), Block 
(1971), Mayo (1970)3 have emphasized the value of providing objectives to 
students as an important part of the mastery learning program. Attention 
(in terms of both theory and research) has given to the question of whether 
students who are provided with objectives will exhibit higher achievement 

- V 

than students who receive no objectives. The findings of the present study 

tend to affirm that objectives lead to enhanced achievement, and support 

/ 

classroom research results such as those of Dalis (1970), and Nelson (1971). 

The findings do not agree with those of Ye I on and Schmidt (1971), although 

✓ 

the learning task used in their study was more complex and of short duration 
(20 minutes). The present findings also disagree with thos ot Jordan (1971) 
(who used a standardized test to measure the effects of objectives), and 
Boardman (1970) (who indicated that there was evidence some students needed 
to be instructed in the use of objectives). 

£& . H 
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This study is perhaps i I lustrative of a typicai college assignment. The 
professor says ”1 would like for you to read this article and we’ll have a 
short quiz on it next time. It's an important article and we'll discuss it 

f 

fully after the quiz." Focusing on the recall of information, the results 
reported here indicate that if the professor also gives a few instructional 
objectives to direct the student, the students will, on the average, score 
about I5£ higher on a recall test with no^loss" of additional information 

i 

f j 

in the article. ( 

In this study, ioJa\ scores on the criterion tcsf were not ignificantly 
higher for subjects who received List "A" objectives — nor would they neces- 

« i 

sari ly be expected to be, as half the test consisted of items for which they' 
had received no objectives. The pattern of scores indicates that had the 
test consisted solely of items related to the objectives List "A", subjects 
who received objectives would have scored significantly higher. This points 
up another area of practical importance to educators who do provide their 
students with behavioral objectives: achievement should t^e measured by test 

items which measure the objectives. When tests evaluate behaviors other than 
those which are "represented in the course objectives, achievement may appear 
to be negatively affected by the presence of objectives. 

Several researchers have suggested that students may need to learn how 
to utilize objectives. In the present study, a training program designed to 
provide knowledge about objectives was supplied to some subjects. The authors 
believed that this type of training, with its stress on the nature of well- 
stated objectives and their relationship to appropriate test items, might 
enable subjects to draw inferences about how to use objectives. However, 
this training did not enhance subsequent performance on a criterion test 
based on a learning task for which objectives were supplied. This was despite 




12 




12 



the fact that training test scores were significantly higher for subjects 
who received the highest level of training, es were attitudes toward objectives. 
(It is well to note, however, that the amount of time spent with the experimenter 
varied across training levels. It is possible that the higher affective scores 
exhibited by Groups I & IV may have been at least a partial function of the 
greater amount of time spent with the experimenter,) 

It is possible, cf course, that training is not ,\eeded to utilize the 
objectives related to tie learning task used in this study. However, it may 
bo that rather than empnasizing knowledge about objectives, a training program 
more specifically concerned with providing practice and strategies for us i ng 
objectives would be more helpful. Believing this to be the case, the authors 
of the present study have undertaken to design and execute such a training 
program (Morse and Tillman, in preparation) . 

The question of whether or not instructional objectives facilitate 
learning does not deserve simply a yes or no answer. We must ask instead 

"Under what instructional conditions do objectives facilitate learning and 

/ 

under what instructional conditions do we find no facilitation of learning? 1 '. 
Studies involving interactions of instructional conditions with the use of 
objectives will provide a basis for developing an effective strategy for using 
objectives. ; 
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Table I 



SCARES ON TRAINING TEST OVER KNOWLEDGE 
ABOUT OBJECTIVES 



Ce ! I summary : 



Total N = 51 

Grand Mean = 
20.04, std. 
dev. - 6.12 



Mager text 
+ instruction 


Mager text only 


No trai ni ng 


1 & IV 


1 1 & V 


III & VI 


X=25. 06 


X=2I .66 


X= 1 3.41 


N = 16 


N * 18 


N = 17 



One-way analysis of variance on scores from training test: 



Source d. f . S.S. M.S. F 

Between 2 1203.58 601.79 40.5*** 

Within 48 709.40 14.79 

Total 1912.98 

#**p< .001 
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Table 2. 



SCORES ON ATTITUDE INVENTORY 



Cell summary: 



Mager text + Mager text No 

instruction only training 





1 & IV 


1 1 5. V 


- 1 1 1 & VI 


Total N = 51 


X=29. 87 


X=27. 77 


X=22. 88 


Grand Mean = 


» 




> 


26.84, std. 
dev. = 4.45 


N= 1 6 


N= 1 8 


N= 1 7 






L \..J 





One-way analysis of variance on scores from attitude inventory: 



Source 


d. f . 


S.S. 


M.S. 




F 




Between 

Within 


2 

48 


428.76 

581.24 


214.38 

12.11 




17.71 *** 



Total 1010.00 



***p < .001 
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Table 3. 



PERFORMANCE ( > CRITERION TEST ITEMS 
MEASJRIN: LIST "A" OBJECTIVES 



Cel I summary : 



Received List 
"A" Objectives 



Received no 
Objectives 

Tota I N=48 
Grand Mean= 12.92 



Mager text + 
instruction 


Mager text 
only 


No training 


1 


1 1 


III 


X= 1 3. 5 


X= 1 3.5 


X=I5. 13 


N-8 


N=8 


N=8 


IV 


V 


VI 


X= 11.38 


X= 1 2. 25 


X=l 1 .75 


N=8 


N=8 


N=8 

~ ~ 



Two-way analysis of variance on scores on test items measuring List "A u : 



Source 


d . f . 


S.S. 


M.S. 


F 




Row (Objectives u A n ) 


1 


60.78 


60.78 


5.28* 


Col . (Training) 


2 


8.06 


4.03 


.35 


1 nteraction 


2 


9. 1 1 


4.59 


.40 


Error 


42 


483.75 


11.52 




Tota*l 


.47 


561.70 







*p< .05 






17 



Table 4 



PERFORMANCE ON CRITERION TEST ITEMS 
MEASURING LIST "B M OBJECTIVES 



Cel I summary : 



Grand Mean=l2.7 





Mage r. text + 
Instruction 


Mager text 
only 


i 

No training 




1 


1 1 


III 


Received List ' 


X-'3 


X= 1 3 


X— 1 3 


"A” Objectives 


N=8 


N=8 


N=8 




IV 


V 


VI 


Received no 


X s 12. 4 


X= 12.1 


X= 12.7 


Object! ves 


N=8 


N=8 


N=8 


Total N=48 


- 


- 





Two=way analysis of variance on scores on test Items measuring List "B": 



Source 


d . f . 


S . S . 


M.S . 


F 




Row (Objectives "A") 


1 


4.09 


4.09 


.36 


Col. (Training) 


2 


.80 


.40 


.04 


Interaction 


2 


. 78 


.39 x 


.03 


Error 


42 


472.25 


11.24 


.. 


Total 


47 


477.92 







o- 
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Table 5 
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PERFORMANCE ON TOTAL CRITERION TEST 



Ce I I summary : 



Received List 
"A n Objectives 



Received no 
Objectives 

Tota I N=48 
Grand Mean=25.6 



Mager text + 
instruction - 


Mager text 
only 


No training 


1 


1 1 


ill 


X=26. 5 


X=26. 5 


X=28. 1 


N=8 


% : 

N=8 


N=8 


IV 


V 


VI 


X=23.8 


X=24.4 


- X=24 . 5 


N=8 


' N=8 


' ' N=8 



Two-way analysis of variance on scores on total- criterion test: 



Scource 



d.f , 
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Row (Objectives "A”) I 
CoJ . (Training) 2 
Interaction 2 
Error 42 
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Total 
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